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ABSTRACT : 

A computational algorithm is presented for the extraction of an 
optimal single linear feature from several Gaussian pattern classes. 

The algorithm minimizes the increase in the probability of mis classi- 
fication in the transformed (feature) space, "Die general approach used 
in this procedure was developed in a recent paper by R.J. P. de 
Figueirodo [1] 

Numerical results on the application of this procedure to the 
remotely sensed data from the Purdue Cl flight line as well as 
LANDSAT data are presented. It was found that classification using 
the optimal single linear feature yielded a value for the probability of 
misclassification on the order of 30% less than that obtained by using 
the best single untransformed feature. Also, the optimal single linear 
feature gave performance results comparable to those obtained by 
using the two features which maximized the average divergence. 
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1. Introduction: 


Let there be given M pattern classes, where M s 2, 
distributed normally in a real n-dimensional Euclidean space , 
Specifically, let the probability density function in E^ conditioned 
on pattern class , j = 1 , . . . , M , be: 

f (x/hJ) = (2Tr)""/2 
X 

exp[-^(x - x^)^(Rj)" ^ (x - x^)] , (1) 

where x=col (x , . . . , x^) , the nxl vector x^ and the nxn 

1 

symmetric positive definite matrix R are the mean and covariance 

of in E” , the superscript T denotes the transpose operation, 

j j 

and ( R ) denotes the determinant of R . Furthermore, assume 
that the a priori probabilities for are given for j = l , . . . , 

M. Endov'ed with these density functions and a priori probabilities, 
the space E^ will be called the measurement or data space. 

In the linear feature extraction problem as formulated in [l] , 
given an integer m such that 1 ^ m ^ n , a linear transformation 

A 

A of rank m from E" to an m-dimensional feature space 
E^(A) is sought so that the Bayes risk (and in particular, the 
probability of misclassification) in E^(A) is minimized over a 
class X of all such transformations A : E^-*E^(A) , satisfying a 
suitable constraint. 

Let 

= Ax , 


y 


( 2 ) 
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yJ = Ax^ (3) 

= A a'^. (4) 


With these formulas, the probability density functions in E^(A) 
conditioned on pattern class , j = l , . . , ,M , may be written as: 




exp [-i(y - y^)'^ 


“I 

(rJ)" 1 (y -yj)] 


(5) 


Thus the Bayes risk in E^(A) can be expressed as: 

MM 

®R<^> = I L '’j ‘^Ij I 

i=i j = i ni(-A) 

^i ^ 

where pj(A) is the Bayesian decision region in E^(A) for 
and the non-negative numbers C.. are the elements of the Bayes 

J 

cost matrix. If = , where fi.. is the Kronecker delta, 

1 J 1 J ij 

the expression for B ( A ) becomes that of the probability of error 
in E ^ ( A ) . 

The constraint that we impose on A is of the form 

g(A) = i trace (A A^^) = cy, (7) 

where o is a positive constant. Incorporating this constraint in 
the expression for the probability of error, and using Lagrange 
multiplier theory, one obtains the criterion functional 
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Q^(A,X) = 


M M 

X X 

i=l j=l 


I fv(y/H^ A) dy + 

Oi(A) ^ 


+ X trace (A 



( 8 ) 


where x is the Lagrange multiplier associated with the constraint 
on A . 

We use an iterative method in determining the extremum of (8). 
For this purpose, an expression for the gradient of Qj^(A, X) with 
respect to the elements of A is required. This expression is : 


V 


A 



(A, X) 


M M 

X X 

i=l j=l 
?^i 

• )'^ A + (R^ )“ ^ 

. ]- + X A , 


E^j I ]. 


( 9 ) 


where, 


= I 

(y - y^)(y - y^)^f (y/Hj,A)dy, 

(10) 

Qi(A) 

V 


E‘j = J 

f (y/H^ , A) dy 

(11) 

f.j(A) 



= I 

(y - y^) A) dy, 

(12) 

ni(A) 




and I is the 


m x m identity matrix. 
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In the present paper, the case in which the dimensionality of 
the feature space is unity, i. e. m=sl, is considered. As a result, 
and y^ , j = 1 , . . . , M , are scalars and A ) , i = 1 , . . . , M , 
consist of one or more intervals of the real line defined by 

flj(A) = {y 6 e \ a ) : Pj fy(y/H*, A) > 

Pjfy(y/HJ,A) Vj.!l }. (13) 


The boundaries of fi ^ ( A ) are chosen from among the roots 
of (13) where the inequality sign is replaced by an equality sign. 

In the one - dimensional case, formulas (10), (11), and (12) have 
closed form solutions thus yielding the following expression for the 
gradient : 


M M ^i 

’A Q,(A,X) I I Pj(-(R^> 

i=l j=:l k=l 

3^i 



A 


T . 


• (01k - y^) - A) + 

+ Pj((R^)‘^ R^ A^ (Oj^ - y^ + 5^). 


• f (“ik / A) + k A , (14) 


where L. = the number of distinct intervals which compose 0.(A), 

X X 

01 k and =0jk are respectively the upper and lower endpoints of 
the intervals of 0 . ( A ) . 

We have used the above expression for tiie gradient of 
Qj^(A,x) in an appropriate iterative algorithm to be described 
in the following section. This algorithm is implemented in the form 
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of a FORTRAN computer program which generates the optimal linear 

A 

transformation A . 

2. Basic Algorithm 

The algorithm that we have just mentioned for computing a 

A 

1 X n linear transformation A and its corresponding Lagrange 
multiplier \ , which minimize the criterion functional Q ( A , x ) 
with 01 = ^ is presented in Fig. 1 . One of the features of this 
algorithm is that, at each iterative step, the value of the Lagrange 
multiplier is updated by a procedure proposed by Tapia in [2], 

It should be noted that in block (d) of Fig. 1 , a single iteration 
of the Davidon- Fletcher- Powell unconstrained minimization procedure 
is performed by leaving the n components of the transformation A 
free to vary and holding \ fixed. More precisely, 

^k+1 "" ^k " ^"'k ^A ^k^' 

tH 

where Kj^ denotes the stepsize at the k step of the algorithm. 
In the block (f) of Fig, 1, the Lagrange multiplier is updated by the 
formula [2] : 

^k+1 ^ ^ < ^k+1 ' ^k+1 > ) ^ ' 

(i- ( II 11^ - 1) " 

< ^k+1 ’ ^A ^^^k + 1^ ^ 

where < • , • > denotes the inner product in E ^ , || • |( 

represents the Froboenius norm in E ^ , and 
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f(A) = Qj(A,i) - i (iiAll^-Ox . (,7) 

3. Optimal Single Linear Gaussian Feature Program 

The above algorithm was implemented in a double precision 
FORTRAN procedure consisting of a main program and several 
subroutines. All software with the exception of the IBM FORTRAN 
SSP double precision version of the Davidon-rletcher-Powell algorithm 
[3] was derived by the authors. The only inputs necessary for the 
operation of the program are the number of pattern classes, the 
dimension of the measurement space, initial values for A and \ 

(if desired), and various control parameters (such as the maximum 
number of iterations of the basic algorithm to be performed, an 
estimate on the value of tlie criterion function at the minimum, etc.) 

4. Numerical Results 

A procedure was developed for testing the validity of the optimal 
single linear Gaussian feature algorithm on remotely sensed data. 

This procedure utilizes the program LARSYS (developed at the 
Laboratorj^ for Applications of Remote Sensing, Purdue University) . 

The test procedure is outlined in Fig. 2. It should be noted from 
this figure that the data set is divided into two mutually exclusive 
subsets ; the training subset A , and the classification subset B . 
These two subsets consist of data from alternate columns of the same 
data fields. As is reflected in the figure, the subset A is used to 
generate the statistics used in finding the optimal single linear 
Gaussian feature. Once the optimal single linear Gaussian feature is 
found, the subset A is transformed accordingly and statistics for 
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classification in the reduced space are generated. The subset B is 
used solely for classification purposes. Thus in no case are the same 
data points used for both the training and classification procedures. 
Generation of smtistics and classification were performed using the 
STAT and CLASS options of LARSYS. The terms "performance" and 
"average performance" alluded to in Fig. 2 are defined as follows: 


Performance = 


# of correct classifications . 

. • _ ,.L_ . .. n_ ■ I - I j j 

total # of classifications 


(18) 


1 M 

Average performance by class ~ — T performance for 

M L 
i = l 

class i. (19) 

The test procedure has been applied to seven test cases. Five 
cases employed twelve channel data pertaining to eight pattern classes 
from the Cl flight line, and the remaining two employed twelve 
channel data belonging to four pattern classes from the LANDSAT. 

A typical Cl flight line data set is given in Table I, The twelve 
dimensional statistics computed by LARSYS for this data set is given 

A 

in Table II. The resulting optimal single linear ti'ansformation A 
is also listed in Table II, 

For comparison purposes, in addition to determining the perfor- 
mance of the optimal single linear Gaussian feature, the performances 
of the best (as computed by utilizing the average interclass 
Bhattacharyya distance criterion) single feature, the best (as computed 
utilizing the average divergence criterion) uvo untransformed features, 
and all twelve untransformed features were computed. The corres- 
ponding results are listed in Table III. It is readily noted that the 
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optimal single linear Gaussian feature gave performance results 
markedly superior to those obtained by using the best single untrans- 
formed feature. Furthermore, the optimal single linear Gaussian 
feature gave r^erformance results comparable to those obtained by 
using the best two untransformed features. Thus one could obtain a 
reduction in storage as well as a reduction in computation effort by 
using the opti nal single linear Gaussian feature instead of the best 
two untransformed channels. 

All calculations were performed using an IBM 370/155 general 
purpose computer at Rice University's Institute for Computer Services 
and Applications. The optimal single linear Gaussian feature program 
operates in 72 K bytes of memory. 

In all test cases, the initial guess for the transformation A 
was made in the following manner. The single feature yielding the 
highest value for the average inter-class Bhattacliaryya distance was 
found. The component of A corresponding to this feature was then 
set to a value of one and the remaining components of A were set 
to zero. Typically for a twelve channel eight class problem, the 
optimal single linear Gaussian feature program converged within forty 
iterations and required approximately five minutes of CPU time. The 
Cl flight line and LANDS AT data as well as the LARSYS program 
were provided by NASA -JSC, Numerous hypothetical cases were 
tested and yielded similar results, but these findings are nor listed here, 

5. Conclusions 

The algorithm presented yields encouraging results. A method 
for finding an optimal n to m transformation, where 1 < m < n , 
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requires a different algorithmic procedure and the results from this 
effort will be available in the near future. 
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Training Set (A) : 

Flight Line Cl 

Run 

No. 6600060 


FIELD DESIGNATION CLASS 


LINES (BY 1) 

COLUMNS (BY 

25- 6-1 

Soybeans 


65- 81 

69- 89 

31-13-1 

Soybeans 


237-253 

141-167 

36- 7-1 

Soybeans 


307-327 

59- 81 

7-23-1 

Soybeans 


773-777 

135-179 

36- 1-1 

Bare Soil 


97-115 

49- 85 

36- 4-1 

Corn I 


167-177 

33- 77 

36- 9-1 

Corn I 


267-283 

45- 61 

36- 8-1 

Corn I 


319-341 

21- 31 

12- 9-1 

Corn 1 


603-625 

13- 33 

31-12-1 

Wheat I 


295-303 

135-175 

6-14-1 

Wheat I 


471-495 

177-201 

7- 2-1 

Wheat I 


607-665 

203-211 

12-10-1 

Wheat I 


656-695 

17- 41 

6- 2-1 

Oats 


365-375 

145-185 

1-11-1 

Oats 


421-455 

63- 83 

7- 1-1 

Oats 


591-599 

135-181 

6-10-1 

Red Clover 

I 

439-447 

139-183 

1- 2-1 

Red Clover 

I 

539-565 

175-195 

1- 3-1 

Red Clover 

I 

599-619 

69- 95 

6- 8-1 

Rye 


527-569 

127-155 

7-24-1 

Alfalfa 


731-737 

129-177 

7-24-3 

Alfalfa 


749-755 

131-171 

7-22-1 

Alfalfa 


809-817 

155-183 


Classification Set (B) : Flight Line Cl Run No. 6600060 


FIELD DESIGNATION 

CLASS 

LINES (BY 1) 

COLUMNS (BY 2) 

25- 6-2 

Soybeans 

65- 81 

70- 88 

31-13-2 

Soybeans 

237-253 

142-166 

36- 7-2 

Soybeans 

307-327 

60- 80 

7-23-2 

Soybeans 

773-777 

136-178 

36- 1-2 

Bare Soil 

97-115 

50- 84 

36- 4-2 

Corn I 

167-177 

34- 76 

36- 9-2 

Corn I 

267-283 

46- 60 

36- 8-2 

Corn I 

319-341 

22- 30 

12- 9-2 

Corn I 

603-625 

14- 32 

31-12-2 

Wheat I 

295-303 

136-174 

6-14-2 

Wheat I 

471-495 

178-200 

7- 2-2 

Wheat I 

607-665 

204-210 

12-10-2 

Wheat I 

656-695 

18- 40 

6- 2-2 

Oats 

365-375 

146-184 

1-11-2 

Oats 

421-455 

64- 82 

7- 1-2 

Oats 

591-599 

136-180 

6-10-2 

Red Clover I 

439-447 

140-182 

1- 2-2 

Red Clover I 

539-565 

176-194 

1- 3-2 

Red Clover I 

599-619 

70- 94 

6- 8-2 

Rye 

527-569 

128-154 

7-24-2 

Alfalfa 

731-737 

130-176 

7-24-4 

Alfalfa 

749-^55 

132-170 

7-22-2 

Alfalfa 

809-817 

156-182 


Table I : Typical Data Subsets 
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_b.v34_“2f 1 7_r4.*.31 

. 72 

4.18 

"3.94* 

2 . 76 

6 . 

33 

5.44 


5'.’93 

4 '. 2 8 

4.56 —1.06 “3.18 

.05 

4 . 46 

2.76 

3.88 

6 ♦ 

27 

5.83 

3.95 

6.67 

5. 68 

5.39 “3.54 “4.C4 

.93 

- 9. 44 

6.33 

0 . 27 

1 5 . 

92 

13,28 

8,17 

12.82 

9.13 

9.01 -3,87 “6.89 

.67 

9 .09 

fa. 44 

5.83 

1 3 . 

28 

15.15 

8.22 

10.44 

6.10 

6.60 2.63 —2.58 

.02 

5.59 

3.81 

3 . 95 

B . 

17 

8 . 22 

6.27 

7 . 79 

5.90 

6. 17 -0.77 -3.48 

.23 

■• ■“S . 62" 

5. ■93 

• 6.6 7 

12, 

82 

10. 44 

7i 79 

18.09 

16.73 

ie.24“15. 07-12. 71 

.71 

6.39 

4 . 28 

5 . 6B 

9. 

13 

6. 10 

5.90 

16.73 

19.43 

16.62-21 .22-1 4.98 

.•_A2. 

6.34 

4 .J>&. 

5. 39 


01 

0 • 60 

6.17 

10.24 

16.62 

18.09-15.71-11 .65 

. 1 2 

“2.17 

-1.06 

~-3~. 54 

— 3. 

67* 

z'. 6 y 

“0 . 7 7“ 

15“.'C7- 

2 1 .'2'2“ 

1 5 ." 7 r 53 7 2 3 " 2*5 7? 7~ 

. 9 2 

“ f . 3 1 

“5,16 

-4 . 04 

“6 . 

89 

- 2 . 58 

-3.48“ 

12.71“ 

14.98“ 

11*65 25.77 24.36 


Table II : Typical Twelve Dimensional Statistics 
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PATTliRN CLASS 5 

veCTOK 


7 ?.. 70 0*3 * .bJi b* . JO 72.36 dO . 04 bB.20 60.93 bb.40 7 6. 90 I 4 1 . 1 1 I 0 7 . bO 

CCVARIANCE MATRIX 

/i ii *#’7i 1 A /**A. ry r\ • a. 


4.31 

2.71 

2 .09 

1 .92 

4 


06 

3,99 

2.62 

3.91 

2. 68 

4 , 02 

4 .91 

3,20 


a.7.L 



„a.04,_ 

4 


1 J_„ .4 .,32,_ 



J.J2 

. 4i2a< 

2...6 2. 



2.09 

1.81 

2.31 

1 . 3b 

2 


77 

2.65 

2.02 

2 .03 

2.C3 

. 2.80 

2'. 4 7* 

0.99 


1.92 

2.04 

1 .35 

2 . 20 

2 


06 

3.00 

2.05 

3.18 

2.48 

2.83 

-0.27 

0.21 


4 . 06 

4.11 

2.77 

2. 86 

7 


68 

6.82 

4.10 

6.64 

4 . 63 

6.00 

6.26 

3.46 

...... 

3. 99 

tt .32 

2.65 

3. 00 

6 


82 

9.96 

b. 1 9 

6 . 53 

4 ,C9 

9.11 

2 0.91 

1 2 .36 


2 . o2 

2 . 56 

2.02 

2.05 

4 


18 

5. 19 

4.16 

4.21 

2.99 

5,20 

0.13 

4.45 


3,91 

4.14 

2.03 

3.18 

6 


64 

0.53 

4.21 

•0.S4 

5,77 

6.13 

-4 . 24 

~1 , 88 

-■ 

2. u8 

3.12 

2.03 

2 . 48 

4 


63 

4 . 09 

2.99 

5.77 

5. 80 

3.92 

-9,13 

~4 .05 


4.02 

4 .22 

2 . 00 

2 , 03 

6 


60 

9.11 

5.20 

6.13 

3.92 

11.65 

20.30 

16.44 


4.91 

2 .62 

2.4 7 

•“0.2 7 

6 


26 

20,91 

8.13 

*•4 . 

“9.13 

2 8.3O2 13.'0bri2*.“4 7 ' 

- 

3.20 

2 .23 

0 .99 

C . 21 

3 


46 

12.36 

4.45 

“1 .88 

“4 . 05 

16. 441 12. 47 

77.52 



PATTbRN CLASS 6 

MEAN VECTOR 


, 7b. 69 7E.02 OO.fab 62,07 b7./2 6.^, 23 6d. 041 01 .93 90. 571 03. 9b bb.b9 72.29 

CCVAR I ANCE MATRIX 

23. b6 £b.03 lb. 3b 19.06 47.06 b0.09 34.30 50.84 43.02 B4.03 40. bl 2b. 44 

,2b. 0 3 32.00 2 1.46 24.3b b6 . B4__6 1 • 1 0_ 4 I . b 7 72.16 b3.43 f-6.42 56.36 51.49 

. 10.36 21.46 1 7.08 17.60 4 1.55 44 . 46 30 . 72”bjVl 2‘ 59 ."l 7 49*. 21““4 H 7 l"li2 .’76™‘“ 

• 19,86 24.35 17.60 21 .02 40.68 51.1 1 35.23 fcl . 1 fa 45. bO 57. 17 47.62 25*93 

47.06 56. 54 41.55 46 . 601 1 2 . t4 1 1 9. 8 3 fa2 . 0 4 I 43 . 2b 1 04 . 9 1 1 3 I . 46 1 1 1 , 4 7 61 .55 
50. C9 61.10 44.46 51.11119.83134.00 91.52157.72115.44144.94125.61 67.77 
34,30 41.57 JO. 72 35.23 82.04 91.52 64.27109.10 80.49101.59 bo. 00 4b. 06 
58.0 4 72,16 53 . 1 2 61 , 1 Bl 4 3 . 201 57 . 721 09 . I 0 1 93 . 74 1 42 . 4 4 1 80 . 90 1 51 . 60 03 . 63 “ “ 
4-3.02 5J.43 J9.1 7 45.001 04.91 1 15.44 oO . 49 1 42 . 44 1 1 1 . 1 01 38. 9bl 1 3 , 43 63.54 

5 4.03 66.42 49.21 5 7. 17131 .461 44.94101 .591 00. 901 38.96102.26149, 19 85.01 

46.51 56.36 ^1.71 47.621 1 1,471 25'. bT 'b 8 .^"0T'5r.6biT3V4 ST 49. l yrAo , 0*0"TO • 40 

25.44 31.49 22.76 25.93 61.55 67,77 46.06 83.63 63.54 05.01 78.40 52.20 




- 

- 

PATTERN CLASS- 7 

^ 

- . 

... ^ _ 


MEAN 

VECTOR 








30.12 

79.79 

6o .68 

65 • 3o 

93 . 92 

96.71 

72.57, 02 .91 

85.13 

99.84 96.05 

75 . 06 

— 

CCVAKl ANCE- 

MATR IX 

... . . , . 


- " - 

- - - ■ 


- 

4 . 79 

3.53 

2.00 

2 , 46 

4 . 28 

2.98 

2.46 5.04 

4 . 84 

4.90 “1.01 

— 0.46 

3.53 

6 .57 

2 • o4 

3 . 30 

5 . 34 

4 . 36 

2.98 6.60 

6.74 

6.4 3 “1.25 

-0 .75 

2.60 

2.04 

3.34 

2.17 

3.77 

2.49 

2. 35 4.62 

4.34 

7v,4 9 “O' .‘60* 

“0 .68 

2.46 

3.30 

2.17 

3.17 

3 . 92 

3.17 

2.50 5.24 

5.41 

5.15 “1.05 

“0 . 04 

4.28 

S , 34 

3.7 7 

3 . 92 

0.71 

5.0 7 

3.79 8.73 

8.56 

8.40 "l.o5 

“1 .30 

2.9 8 

4 • 30 

2.49 

3.17 

3 , 07 

5.61 

3.34 7 . 35 

7 , 54 

7.10 “0.57 

“0,43 

2.46 

2 . 58 

2.35 

2. 50 

3 . 79 

3 . 34 

3.74 5.51 

5.75 

5.66 0.17 

-0 . 79 

' 5.C4 

6 .60 

4 . 62 

5.24 

8 . 73 • 

7.3b 

S.5il-- 14.45 

13.27 

12.80 “2.69 

“2.27 " ' 

4 . 04 

6 . 74 

4.34 

5,41 

8 . 56 

7.54 

5.75 13.27 

15.21 

13.18 “3.19 

“2 . 50 

4 . 90 

C . 43 

4 . 49 

5, 1 5 

6 . 48 

7.1b 

5.0 6 12.80 

13.18 

14.92 -1.45 

“1.44 

“1 .C 1 

••1 • I? tj 

“0,60 

“1.05 

- 1 .85 

-0TS7 

0.17 “2.69 

19 

"1.45 l7.bl 

3.79 ; 

“0.46 

~C . 75 

“C .68 


“1 , 30 

-0.43 

“0,79 “2.27 

“2.56 

“1.44 3.79 

6.16 


- 



- PATTF--RM-CI ASS A . 





MEAN 

VECTOR 








77.10 

71 , 98 

55.7 4 

55- 62 

75 . 69 

05.19 

60.70 70.25 

55.04 

78.571 51 .651 11.78 , 


VMK 1 AINCt 

Ma IRIX 






' 

3.51 

2.63 

2.19 

2. C3 

3 . 53 

1 .82 

1.79 4.50 

3.97 

2.08-13.45 

“8 . 45 

2.63 

5 .07 

2.52 

2 . 79 

4 . 62 

2.65 

2,40 6.38 

5.95 

3. 1 2-18.02- 

•1 1 . 52 

2.19 

2.52 

3.02 

2 . 00 

3 . 57 

1 . 0 0 

2,10 4.39 

4 . C7 

2. 37-12. 85 

“8 .55 

2.03 

2 , 79 

£•00 

3.04 

3 . 65 

2.14 

2.10 5.05 

4 . 83 

2.47-15.78 

“9.15 

3.53 

4.62 

3.57 

• 3 • o5 

a, 08 

3. 99 

3-56 9.C2 

7.74 

4,70-25.46-15.88 -- - 

1 .02 

2.65 

1 .88 

2.14 

3 . 99 

4 . 29 

2.79 5.47 

4 • 65 

3.50-13.33 

-7.00 

1.79 

2-40 

2.10 

2.10 

3 . 56 

2.79 

3.34 4 .84 

4.47 

3.05-13.26 

“0.19 

■ 4.50' 

'•6.38' 

■ 4,39 - 

• S . 0 5'" 

9. 02- 

"5.4 7 

4 ."04 13.32 

11.30 

6. 25-36. 6 8-21 .31 

3.9 7 

5.95 

4.07 

4 .83 

7 . 74 

4.85 

4.47 11.30 

11.91 

5 . 6b— 35 * 3 7- 

20.27 

2.0 8 

3.12 

2.37 

2.47 

4., 70 

3 .50 

3.05 6.25 

5.60 

S .66-14 . 70 

-8.74 

“13.45- 

1 a . c2- 

>1 2.85“ 

15. 78“ 

25 . 46“ 

13.30" 

1 3.2e-36.6b“33,37~14.70157.50 

81 .92 

-a. 45- 

1 1 . 52 

-8.55 

“9.15“ 

15.88 

-7 . 8b 

“8 . 19“21 .31-20.27 

“6.74 01.92 

59.72 

II 

-.44040 

38796 

.04587 

-.23900 

. 08003 

-. 23782 



.12532 

43812 

. 51823 

-.03791 

.07618 

21596) 
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Total # of 

Performance Results 

Test Case 

Points in 
Data Set 

Optimal Single Linear 
Gaussian Feature 

Best Single 
Feature 

Best Two 
Features 

All Twelve 
Features 

I -Cl 

10,944 

.740 

.553 

.797 

.990 

II -Cl 

9,941 

.759 

.648 

.892 

.992 

ill -Cl 

9,941 

.667 

1 

. 620 

.886 

.986 

’ IV -Cl 

14,997 

. 803 

. 683 

.857 

.993 

V -Cl 

14,997 

. 799 

.664 

. 849 

. 993 

VI -landsat 

1,051 

.850 

.834 

.864 

.918 

VII-LANDSAT ^ 

1,051 

.847 

.831 

.875 

.933 

1 


I Average Performance by Class Results 



Optimal Single Linear 
Gaussian Feature 

Best Single 
Feature 

Best Two 
Features 

I All Twelve 
Features 

I -Cl 

10,994 

.739 

.575 

.813 ‘ 

.990 

II -Cl 

9,941 ' 

.739 

.610 

. 860 

.993 

III -Cl 

9,941 

. 706 

. 6l5 

. 871 

.975 

IV -Cl 

14,997 

.782 

. 651 

. 854 

.993 

V -Cl 

14,997 

.784 

.653 

.848 

.993 

VI -landsat 

1,051 

.860 

. 827 

. 868 

. 923 

vii-landsat 

1,051 

.856 

.803 

.869 

.935 


Table III; Test Case Results 












